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Abstract 


‘There is growing awareness of the importance of dispositional attributes to effective performance, both during 
college and in the workplace. In this paper, we examine multiple facets of dispositional learning such as fluid 
intelligence and interpersonal and intrapersonal competencies, and explain why participation in well-designed 
high-impact practices (HIPs)—activities such as learning communities, service learning, undergraduate research, 
and community engagement—can help students cultivate conscientiousness, resilience, self-regulation, reflection 
and other learning dispositions. In addition, we demonstrate how and why the use of ePortfolio practice can 
extend, deepen, and document the impact of HIPs on these essential but often overlooked and difficult-to- 
measure attributes. 
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Using ePortfolio to Document and Deepen the 


Impact of HIPs on Learning Dispositions 


George D. Kuh, Laura M. Gambino, Marilee Bresciani Ludvik and Ken O’Donnell 


There is trouble in the land. 
_ ee eS 
Skepticism about the value of college in the U.S. is pervasive. As recently as 


2009, more than half of Americans believed college was necessary for success Most informed observers generally 
in the work world. By 2016, Public Agenda reported that share had fallen to agree that in addition to up-to- 
42%, with a corresponding rise in sentiment to the contrary, that “there are date technical knowledge, virtu- 

> 


many ways to succeed in today’s world without a college degree. ally every field of endeavor in the 


The good news is that the economy has improved. The bad news is the public future will seek college graduates 
is not inclined to share the turn toward prosperity with state support to colleges who are proficient in a range of 
and universities at anything near pre-recession levels. Why? One major factor competencies. 


could be the questionable quality of undergraduate education. 


According to the 2017 report from the Academy of Arts and Sciences’ Com- 
mission on the Future of Undergraduate Education, the nation’s top priority 
must be to strengthen the student educational experience: 


What was once a challenge of quantity in American undergraduate 
education, of enrolling as many students as possible, is increasingly 

a challenge of educational quality—of making sure that all students 
receive the education they need to succeed, that they are able to com- 
plete the studies they begin, and that they can do all of this affordably, 
without mortgaging the very future they seek to improve (p. 1). 


Those familiar with the series of reports commissioned by the Association of 
American Colleges and Universities (AAC&U, 2015) about what employers 
want and need from colleges and their graduates were forewarned (https:// 
www.aacu.org/leap/public-opinion-research). The consistent theme in these 
studies across the past decade conducted by Hart Research Associates is that 
too many college graduates lack the skills and competencies that translate well 
to the workplace. A 2017 report from McKinsey & Company by Manyika and 
colleagues about what is needed to respond to the near-term dynamic, rapidly 
evolving conditions in the workplace concluded that “Acquiring new skills that 
are in demand ... will be critical” for both individual and organizational suc- 
cess. 


Most informed observers generally agree that in addition to up-to-date techni- 
cal knowledge, virtually every field of endeavor in the future will seek college 
graduates who are proficient in a range of competencies, some of which are 
time-honored expected outcomes of college such as critical thinking, analyti- 
cal reasoning, clarity of thought and expression. Other attributes have more 
recently ascended in importance including curiosity; self-regulation; conscien- 
tiousness; flexibility; and the ability to work effectively with people from 
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diverse backgrounds, especially those who hold varying perspectives on how to 
identify and devise solutions to messy, unscripted problems. Many of these at- 
tributes are reflected in the AAC&U Essential Learning Outcomes (2007) and 
the Degree Qualifications Profile (Lumina Foundation, 2014). 


Admittedly, most of these attributes need greater definitional precision to mea- 
sure and document them to determine where, when, and to what extent they 
emerge or deepen during the undergraduate experience. And this is why we 
can no longer ignore them, given the groundswell of interest by stakeholders in 
ensuring that graduates have acquired what have often been considered to be 


so-called ineffable, “soft skills.” 


Toward this end, for this paper we appropriate the term, dispositional learning, 
to represent those attributes represented by intrapersonal competence, interper- 
sonal competence, and transferable neurocognitive skills which were recently 
featured in the National Academy of Science, Engineering, and Mathematics 
report (Herman & Hilton, 2017). Briefly: 


° Interpersonal competencies involve expressing information to 
others as well as interpreting others’ messages and responding 
appropriately. 

° Intrapersonal competencies involve self-management, growth 
mindset, and the ability to reflect on and manage one’s behav- 
ior and emotion to reach goals. 

° Neuro-cognitive skills (Zelazo, Blair, & Willoughby, 2016) rep- 
resent both (a) crystallized intelligence and (b) fluid intel- 
ligence that together are needed to monitor and self-regulate 
thought processes and behavior, which is essential to the 
development of inter- and intra-personal competencies as well 
as the ability to demonstrate applied knowledge. 


Later we'll say more about these attributes. 


For various reasons, dispositional learning heretofore has been under-em- 
phasized in curricular offerings and under-examined in efforts to document 
collegiate outcomes. One step toward regaining the public trust and assuring 
stakeholders, including students, that graduates are prepared to survive and 
thrive during and after college is for postsecondary institutions to directly focus 
on cultivating dispositional learning (Figure 1). 
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Challenges Opportunities es 


It is worth noting that neuroscien- 
gt av nse tists do not equate or refer to dis- 
& i - act Practice o,e . . 
a ee positional attributes as soft skills, 


inasmuch as there is nothing soft 

shee iaenia about their acquisition or their 
W Colleviate haart relevance and worth in respond- 

Quality Qe ing to unanticipated, complex 


circumstances, inside and outside 
Neurocognitive Learning the classroom during college as 
Outcomes Assessment well in virtually every dimension 
Figure 1: Selected challenges and opportunities for improving the undergradu- 
ate educational experience. 


Shrinking Support 


We further posit that high-impact practices (HIPs)—activities such as learning 
communities, service learning, undergraduate research, and community en- 
gagement — may be especially good for promoting the particular dispositional 
attributes that are in growing demand if the experience is consistent with the 
educationally effective features common to a HIP. The ePortfolio—recently rec- 
ognized as the 11 High-Impact Practice (Kuh, 2017; Watson, Kuh, Rhodes, 
Penny Light, & Chen, 2016)—can play a powerful role in deepening and mak- 
ing visible the benefits of participating in a HIP. 


We turn first to a brief overview of the literature related to High-Impact Prac- 
tices, both as originally presented, and as subsequently advanced in a decade 
of remarkably broad and rapid adoption. Then, we discuss in more detail the 
nature of dispositional learning and how to document the neurocognitive at- 
tributes likely associated with participation in HIPs. Some of what is needed 
already exists, including a detailed vocabulary and mapping of the so-called 
“soft skills” and “ineffable” learning outcomes we seek (many of which, it turns 
out, are effable). It is worth noting that neuroscientists do not equate or refer 
to dispositional attributes as soft skills, inasmuch as there is nothing soft about 
their acquisition or their relevance and worth in responding to unanticipated, 
complex circumstances, inside and outside the classroom during college as well 
in virtually every dimension of post-college life. 


But this kind of learning can be hard to measure, which is why we next 
describe how ePortfolios can record, extend, and deepen the dispositional 
attributes associated with a HIP and aligned undergraduate experiences. By 
narrating and making sense of their experiences as they go along, and sharing 
with others their evolving sense of learning and personal development, students 
can demonstrate the degree to which they have developed these dispositional 
attributes and other important outcomes. We close with some reflections on 
what the convergence of HIPs, dispositional learning, and ePortfolio work can 
mean for delivering on the promise of college in coming years. 
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High-Impact Practices and Dispositional Learning 


Just over a decade ago, the phrase High-Impact Practices (HIPs) began to 
appear in the higher education literature. HIPs is an umbrella term referring 

to certain educationally effective activities associated with unusually positive 
benefits for the undergraduate students who participate in one or more of 
them (Finley & McNair, 2013; Kuh, 2008; Kuh, O’Donnell, & Reed, 2013). 
The first mention was in George Kubh’s essay in the 2006 National Survey of 
Student Engagement (NSSE) annual report. It appeared again a few weeks later 
in College Learning for a New Global Century (AAC&U, 2007). 


The original list of HIPs included ten practices (Kuh, 2008) with ePortfolio 
put forward as the eleventh HIP in 2017 as already noted. Indeed, for reasons 
discussed later, some consider ePortfolio to be a meta-HIP connecting and en- 
hancing the influence of other HIPs on desired outcomes (Eynon & Gambino, 
2017; Hubert, Pickavance, & Hyberger, 2015; Kahn, 2014). 


Efforts to study and expand the number of students who participate in a HIP 
have become something of a juggernaut (Kuh, O’Donnell, & Schneider, 2017). 
Indeed, in 2017, 50 percent of provosts responding to a survey conducted by 
the National Institute for Leaning Outcomes Assessment (NILOA) reported 
that their institution was taking action to increase the number of HIP-like 
experiences for students, to expand access to HIPs, or to enhance their quality 
(Jankowski, Timmer, Kinzie & Kuh, 2018). 


What has fueled this groundswell of interest? As noted earlier, the vast majority 
of colleges and universities are seeking ways to enhance the quality of student 
learning for ALL students in ways that increase the likelihood that students will 
complete what they start-—whether it be a baccalaureate or associate degree, or 
another postsecondary credential. Schools also are mindful that stakeholders 
expect the postsecondary experience to prepare graduates who will be effec- 
tive in the workplace, in civic affairs, and in one’s personal life. In this context, 
HIPs are especially attractive because: 


(a) They are associated with unusually positive effects on a variety 
of desired learning and persistence outcomes; 

(b) They typically require applied, hands-on practice necessary for 
deep, meaningful, integrative learning over an extended period 
of time; 

(c) They have compensatory effects for students from historically 
underserved populations (that is, students get a boost in their 
performance); 

(d) They shrink the psychological size of the institution because 
students get to know well at least one faculty or staff member 
and a small affinity group of peers; and 

(ec) These positive effects on learning and persistence become cu- 
mulative and additive when students participate in multiple 
HIPs during their undergraduate program. 


a 
High-Impact Practices (Kuh, 2008) 
¢ First-Year Seminars and Experiences 
¢ Common Intellectual Experiences 
¢ Learning Communities 
¢ Writing-Intensive Courses 


¢ Collaborative Assignments and 
Projects 


¢ Undergraduate Research 

¢ Diversity/Global Learning 

¢ Service/Community-Based Learning 
¢ Internships and Field Placements 

© Capstone Courses and Projects 

¢ Portfolio 
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Eight Key HIPs Features Illustrated 
Performance expectations set at appropriately high levels 


Example: A writing- or inquiry-intensive first-year seminar in which assignments, projects, and activities such as 
multiple short papers, problem sets or projects challenge students to achieve beyond their current ability level as 
judged by criteria calibrated to students’ pre-college accomplishment evidenced by placement tests or ACT or SAT 
scores. 


Significant investment of concentrated effort by students over an extended period of time 


Example: A multiple-part class assignment or community engagement project on which a student works over the 
course of the academic term, beginning with a synopsis of the problem or issue to be examined and the methods or 
procedures that will be used, followed subsequently with narrative sections describing the methods, findings, and 
conclusions which together culminate in a completed paper, demonstration or performance evaluated by an 
independent third party or faculty supervisor. 


Interactions with faculty and peers about substantive matters 


Example: Out-of-class activities in which students in a learning community or first-year seminar come together at least 
once weekly to attend an enrichment event such as lecture by a visiting dignitary and/or discuss common readings and 
assignments facilitated by an upper-division peer mentor. 


Experiences with diversity, wherein students are exposed to and must contend with people and circumstances that 
differ from those with which students are familiar 


Example: A service learning field assignment wherein students work in a setting populated by people from different 
backgrounds and demographics, such as an assisted living facility or shelter for abused children, which is coupled with 
class discussions and journaling about the connections between class readings and the field assignment experience. 


Frequent, timely, and constructive feedback 


Example: A student-faculty research project during which students meet with and receive suggestions from the 
supervising faculty (or staff) member at various points to discuss progress, next steps, and problems encountered and 
to review the quality of the student’s contributions up to and through the completion of the project. 


Opportunities to discover relevance of learning through real-world applications 


Example: An internship, practicum or field placement that requires that students apply the knowledge and skills 
acquired during their program of study, or supervisor mediated discussions among student workers that encourage 
students to reflect on and see the connections between their studies and experiences in the work setting. 


Public demonstration of competence 


Example: An oral presentation to classmates of the required capstone seminar product that is evaluated by a faculty 
member and/or an accomplished practitioner, or a narrative evaluation of an internship, practicum or field placement 
by the work setting supervisor and/or supervising faculty or staff member. 


Periodic, structured opportunities to reflect and integrate learning 


Example: Linked courses in a learning community wherein an instructor of one course designs assignments that require 
students to draw on material covered in one or more of the other linked courses supplemented by a peer preceptor who 
coordinates student attendance and discussion at relevant campus events, or a capstone course in which students 
finalize their ePortfolio and explain the relative contributions of the artifacts contained therein that represent the 
knowledge and proficiencies attained at various points during their program of study. 


Figure 2: Eight Key HIPS Features Illustrated. 
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None of the various behaviors characteristic of a HIP are unusual (Figure 2). 
Indeed, they can be found or incorporated in any classroom, lab, or studio as 
well as in educationally purposeful out-of-class activities that are intention- 

ally structured to emphasize the features of a HIP. Examples of the latter are 
student government or organization leadership positions, campus employment, 
peer mentoring and tutoring, intercollegiate athletics (with the right coaching 
approach), student publications, touring concert bands and choirs, and so on. 
What seems to contribute to the consequential impact of a HIP is that students 
experience a combination of many of these effective educational features during 
the time they participate in the respective HIP (Figure 2). 


Indeed, when done well, participating in a HIP is developmentally powerful 
and replete with opportunities to apply, reflect and integrate what one is learn- 
ing. In fact, some see the HIPs framework as an especially promising approach 
for helping ensure access, equity, and educational quality. As mentioned earlier, 
there is a fair amount of research documenting the relationships between HIP 
participation and a range of desired outcomes (e.g., Brownell & Swaner, 2010; 
Finley & McNair, 2013; National Survey of Student Engagement, 2007, 2013, 
2017). Not yet systematically examined is whether and the extent to which in- 
volvement in a HIP is linked with what we and others refer to as dispositional 
learning, such as the attributes briefly introduced earlier. 


For example, the National Science Foundation recently commissioned the 
National Academy of Science, Engineering and Mathematics (the National 
Academies) to examine and identify a range of competencies that research 
shows may be related to postsecondary persistence and success, with a par- 
ticular emphasis on how those competencies can be intentionally cultivated, 
assessed, and enhanced. The Academies charge was to gather evidence that 
would support and expand efforts to foster student success in STEM (science, 
technology, engineering, and mathematics) with an emphasis on students from 
historically underrepresented backgrounds. But what it learned about promis- 
ing strategies to help undergraduates develop intrapersonal, interpersonal and 
cognitive competencies has implications for enhancing the quality of education 
for all students. More will be said soon about these attributes; suffice it to say 
that they are widely considered to be key to effective performance during and 
following college. 


The National Academies report (Herman & Hilton, 2017) found that the 
competencies across all three domains were closely intertwined with—and 
supported the acquisition of—core knowledge and skills in science, mathemat- 
ics, and English language arts. There is every reason to believe putting students 
in situations that demand they acquire and practice these competencies would 
confer similar benefits, college major notwithstanding. And there also is good 
reason to expect that participating in a HIP or other activity with the HIP- 
like features suggested in Figure 2 would put students in situations where they 
encounter messy, unscripted circumstances and need to expend effort on tasks 
that test their resolve, inducing them to practice and over time cultivate the 
dispositional learning that the National Academies, employers, and others as- 
sert are essential for success during and after college. 


Indeed, when done well, partici- 
pating in a HIP is developmen- 
tally powerful and replete with 
opportunities to apply, reflect and 


integrate what one is learning. 
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For example, HIPs typically put students in situations that require them to 
communicate and work effectively with peers and others in real time. A good 
example is a biology course with a community-based project where groups of 
students take responsibility for reclaiming an area of land that has been neglect- 
ed and overgrown. Students are expected to organize their time in the field in 
an efficient manner and use some of what they have learned in class to deter- 
mine which plants are indigenous to the region and which found their way into 
the area. Another expectation is that students be mindful of what they do not 
know to complete the project, and to reflect on and discuss their experience 
with their classmates and the instructor at the next class meeting. Invariably, 
unanticipated circumstances arise to which students must adapt and respond. 


Another common example is study abroad where students encounter and must 
figure out how to successfully navigate a novel environment and culture, learn- 
ing together what they need to know in real time to communicate in a different 
language and manage their resources effectively. Such situations, especially at 
first, create stress which in turn demands that students demonstrate resolve and 
flexibility, and learn how to deal with others who are grappling with similar 
challenges. 


In both these examples, students are often surprised to see and hear their peers 
say and do unexpected and occasionally off-putting things. Such circumstances 
present opportunities every day to practice and develop some level of confi- 
dence and competence in the range of proficiencies represented by the multiple 
dimensions of dispositional learning and some suggestions for how to docu- 
ment the impact of these experiences, topics to which we turn next. 


A Closer Look at Dispositional Learning 


In order to assess dispositional learning associated with HIPs participation, we 
must first better understand what constitutes malleable dispositional attributes 
and what they look like in everyday life. Drawing on the work of Scharmer 
(2009) and Duckworth (2016), Figure 3 suggests the outcomes we often assess 
are the outcomes that we can more easily identify and measure, such as that 
represented by test scores and other metrics assumed to correlate with per- 
formance indicators, such as persistence and graduation rates. These are the 
surrogates for learning that many educators and leaders focus on when writing 
policy or making decisions. However, if we think of the desired outcomes in 
terms of an ocean ship captain encountering an iceberg, it’s not the tip of the 
iceberg the part immediately visible to which the captain attends. Rather, it is 
what lies underneath that warrants the most attention. To avoid a potentially 
fatal shipwreck, a good ship captain will always pay much more attention to 
the part of the iceberg that lies beneath the surface. To assure that students and 
the larger society obtain the learning they want and need, we must direct more 
attention to that which seemingly lies beneath the surface of the easily identifi- 
able learning. And that is what we are calling dispositional attributes. 


Because dispositional attributes represent both what is readily identifiable as 
well as what lies beneath the surface, these attributes are foundational to deep, 
meaningful learning. Thus, we need to de-construct dispositional attributes in 
order to identify how and where they can be assessed at various points along 
student’s educational journey. 


The outcomes we often assess are 
the outcomes that we can more 
easily identify and measure, 

such as that represented by test 
scores and other metrics assumed 
to correlate with performance 
indicators, such as persistence and 
graduation rates. 
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Figure 3. Iceberg Analogy of Dispositional Learning of post-college life. 


For purposes of this paper, “‘learning,’ ‘personal development,’ and ‘student de- 
velopment are considered “inextricably intertwined and inseparable” (Ameri- 
can College Personnel Association, 1996, p. 2). This view is consistent with 
findings from cognitive neuroscience research which uses multiple measures of 
functional neural brain imaging, physiological marker assessment, behavioral 
task assessment, and first-person self-reports to better understand how people 
learn and what is needed to deepen learning. 


Summarizing the major findings of neuroscience research for the Institute of 
Education Sciences (IES), Zelazo, Blair, and Willoughby (2016) explained the 
intricate connections between cognitive learning, experiential learning and 
personal development, referring to these behaviors as neurocognitive skills that 
are malleable and can be intentionally influenced. They divided neurocognitive 
skills into two categories: (1) crystallized intelligence and (2) fluid intelligence 
or executive functions. Returning to the iceberg analogy, crystallized intelli- 
gence represents the tip of an iceberg—easily identifiable facts and knowledge. 
Fluid intelligence or executive functions are more challenging to discern—the 
foundational base lying below the surface. Equally important, the learning and 
personal development behaviors associated with aspects of neurocognitive skills 
may take different forms, depending on the particular contexts in which they 
are found. 


For example, consider dispositions that may come to the fore when a group of 
students enrolled in a HIP are engaged in environmental sustainability prob- 

lem solving during a service-learning field experience, and a separate group are 
engaged in a similar problem-solving activity within a capstone course project. 


The learning and personal devel- 
opment behaviors associated with 
aspects of neurocognitive skills 
may take different forms, depend- 
ing on the particular contexts in 


which they are found. 
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Problem solving requires a set of crystallized intelligence functions related to 
environmental sustainability. In this context, crystallized intelligence and fluid 


intelligence may look similar. However, the unexpected environmental influ- Using appropriate assessment 
ences of the field experience may require the application of different self-con- approaches, it may be pos- 
trol, conscientiousness, effortful control, and openness than would be used in Chietodocianene bomicertaat 


a classroom (Bresciani Ludvik, 2016; Bresciani Ludvik, 2017). To help identify 
these malleable neurocognitive skills, Zelazo, Blair, and Willoughby (2016) 


educational activities such as 


further divided fluid intelligence or executive functions into three categories: (a) 
cognitive flexibility, (b) working memory, and (c) inhibitory control. 


* Cognitive flexibility involves a person’s ability to think about 


any one thing in multiple manners; this would include taking 


HIPs contribute to student 
persistence, thereby yielding 
actionable information be- 
yond recording the number of 
students who persist or com- 


into account someone else’s perspective or knowing how to plete a degree. 
solve a single problem in a number of ways. This would be 
useful, for instance, in demonstrating an openness towards 
learning about others cultures or ideas and how that might 
change in certain contexts. 

© Working memory involves both being able to recall known 
information in a relevant context and, applying it in some 
fashion, such as integrating multiple pieces of known informa- 
tion in a workable, meaningful, and appropriate method 
within the relevant system. 

¢ Inhibitory control is the process of intentionally directing at- 
tention away from a distraction, stopping an impulsive behav- 
ior, or not acting on a highly learned or engrained habit (Bres- 
ciani Ludvik, in press, pp. 3-4). 


Figure 4 illustrates this conceptual alignment. 


Cognitive Flexibility 


Fluid 
Intelligence/Executive Working Memory 
Functions 


Inhibitory Control 
Neurocognitive Skills 


Figure 4: Learning and Development as Neurocognitive Skills 
(Adapted from Zelazo, Blair, & Willoughby, 2016 by Bresciani Ludvik, M. J., in 
press). 
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While cognitive neuroscience research confirms the inseparable links between 
learning and personal development, it is not particularly actionable for those 
who want to determine the extent to which certain dispositional attributes are 
associated with a HIP experience or which features of a HIP (or any other edu- 
cational experience) influence which outcomes. As we shall see later, however, 
when done well, ePortfolio has great promise for documenting and enriching 
the utility of crystallized intelligence (facts, knowledge) as well as fluid intel- 
ligence—the multiple contexts in which that crystallized intelligence is applied 
which also may reveal evidence of dispositional learning. 


Figure 5 contains language more familiar to many educators, assigning execu- 


tive functions into two categories: (a) temperament and personality, and (b) 
positive goal-directed behavior. Keep in mind that these neurocognitive skills 


Neurocognitive Skills: Executive Functions 


* Cognitive Flexibility 


* Working Memory 
* Inhibitory Control 


Figure 5: Semantic Map of Executive Functions and Related Terms 
(Adapted from Zelazo, Blair, & Willoughby, 2016 by Bresciani Ludvik, M. J., 
2017). 


are presumed to be malleable (Bresciani Ludvik, 2016; Bresciani Ludvik, 2017; 
Chaterjee et al, 2017), potentially shaped in desirable ways through intention- 
ally designed curricular experiences and educationally purposeful out-of-class 
activities. Using appropriate assessment approaches (such ePortfolio discussed 
later), it may be possible to document how certain educational activities such as 
HIPs contribute to student persistence, thereby yielding actionable information 
beyond recording the number of students who persist or complete a degree. 
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As noted earlier, the National Academies (Herman & Hilton, 2017) set out to 
examine outcomes closely related to dispositional learning, including whether 
and to what extent intrapersonal and interpersonal competencies are related to 
student persistence and success especially in STEM. The project also examined 
whether these competencies could be enhanced through purposeful curricular 
design and other interventions. Figure 6 is an abbreviated summary of the 
National Academies findings which correlate well with allied efforts. The terms 
used by Zelazo et al., (2016) are purple and the corresponding Herman and 
Hilton (2017) terminology is dark gold. 


Efforts to assess the dispositional attributes represented in Figures 3-6 are in a 
nascent stage. Fortunately, several pre- and post-experience inventories already 
exist, which could be used to document the extent to which certain of these 
attributes are associated with participating in a HIP. Among them are Dweck’s 
(2006) Growth Mindset Scale, Duckworth and team’s (2007) Grit Scale, Jazai- 
eri et al. (2014) compassion scale to assess prosociality, and the Hoffman et al. 
(2002) Sense of Belonging Scale. Appendix A contains a longer list of potential 
assessment tools. 


Temperament and 


Personality 
Neurocognitive Skills: 
Executive Functions 
e Cognitive Flexibility 
e Working Memory 
e Inhibitory Control 


Goal-Directed 


Behavior 


Effortful Control 
Conscientiousness 
Openness 


Grit 


Growth Mindset 


Sense of Belonging 


Self-Control 
Reflective Learning 
Deliberate Problem 


Solving 
Emotion Regulation 
Persistence 


Planning 


Prosocial Goals and 
Values 
Positive Future Self 
Academic Self-Efficacy 


Figure 6: Semantic Map of Executive Functions and Related Terms to Intra- and Inter- 
Personal Competencies (Adapted from Zelazo, Blair, & Willoughby, 2016 by Bresciani 


Ludvik, M. J., 2017). 
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We point to these extant tools to stimulate ideas for how these and allied data 
collection approaches could be used as part of ePortfolio work. Of special inter- 
est is to stimulate efforts that examine how well the HIPs features outlined in 
Figure 2 are present in students’ educational experiences and to what extent the 
respective HIP features are linked to specific dispositional attributes. As with 
any quality assessment effort (Kuh, Ikenberry, Jankowski, Cain, Ewell, Hutch- 
ings, & Kinzie, 2015), this work must begin with clear, specifically-worded 
intended outcome statements aligned with a particular attribute or personal 
development outcome. 


For example, a specified outcome of the San Diego State University Semi- 

nar Series for first-year commuter students is that students will describe two 
meaningful connections they made during their first semester. This outcome 

is related to a university-wide goal to cultivate sense of belonging and foster 
engagement among all university students. The former is measured by the 
Hoffman et al. (2002) Sense of Belonging scale and the latter by the National 
Survey of Student Engagement. The seminar is designed to provide students 
with crystallized knowledge about where and how to make connections; 
instructors can add assignments that require students - for example - to meet 
with their faculty advisor, investigate at least one student organization of inter- 
est, or engage in a cultural center activity, activities that encourage students to 
make meaningful connections among these experiences. To deepen learning, 
students do reflective journaling (student self-report) and complete pre- and 
post-seminar inventories to measure well-being, attention and emotion regula- 
tion, as well as ethnic belonging to name a few. Course designers and instruc- 
tors use this information to improve the seminar and student learning. One of 
the most promising approaches to compiling evidence from such a multifaceted 
learning experience seminar is the ePortfolio. 


Using ePortfolio to Document Dispositional Learning Associ- 
ated with HIPs 


If dispositional attributes in the form of intrapersonal and interpersonal 
competencies exist “beneath the surface,” how might we make them, as well 

as neurocognitive skills, more accessible for assessment—either internal (self) 
or external (institutional or employer) assessment? A reflective ePortfolio can 
make these types of learning associated with participating in a HIP more visible 
to students, faculty, staff, and external audiences. 


The term “ePortfolio” often triggers the image of a technology platform or 
product. While the technology platform is essential, “ePortfolio” is much more 
than a technology, much more comprehensive than any particular platform 

or vendor product. ePortfolio is a coherent set of effective educational practices 
that link reflective, integrative and social pedagogy. ePortfolio practice supports 
learning across boundaries—inside and outside the classroom, advising pedago- 
gies, and educational and career development. ePortfolio is also a process that, 
when done well, deepens reflection and dispositional and integrative learning, 
over time and across these boundaries. Together, those practices and processes 
yield an organic product—an evolving multimedia collection of artifacts, reflec- 
tions, and experiences that form a digital narrative of a student’s academic 
journey. 


The term “ePortfolio” often trig- 
gers the image of a technology 
platform or product. While the 
technology platform is essential, 
“ePortfolio” is much more than 
a technology, much more com- 
prehensive than any particular 
platform or vendor product. 
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Practitioners often categorize ePortfolio into different types—showcase, assess- 
ment, and learning ePortfolios: 


¢ Showcase, or career ePortfolios, are externally facing, used to 
share one’s “best” self, including examples of learning for 
potential employment or transfer opportunities. 

Assessment ePortfolios provide institutions and other interest- 
ed parties artifacts of work, and possibly reflections, often tied 
to programmatic or institutional learning outcomes. 

Learning ePortfolios, the category we will focus on in this pa- 
per, provide students the space and structure to focus on 
practice and process, enable students to construct knowledge 
for various audiences, make connections among learning 
experiences, and - through reflection - understand the ways 
they are developing as self-directed life-long learners. 


ePortfolio, therefore, is a set of re- 
flective practices that, when done 
well, makes authentic learning 
and personal development visible, 
comprehensible, and meaningful, 
induces students to draw connec- 
tions between various learning 
and personal development experi- 
ences inside and outside of class 
on and off the campus, fosters 
integrative learning, and deepens 
dispositional attributes. 


The role of reflection in ePortfolios is essential, because the reflective component 
helps to make the implicit “beneath the surface” learning explicit. Thus, learning 
ePortfolios are sometimes referred to as reflective ePortfolios. 


A common question from those unfamiliar with or new to working with eP- 
ortfolios is, “What difference does the ‘e’ make?” Eynon and Gambino (2017) 
argue that the “e,” the technology platform, is an essential component of a 
high-impact ePortfolio practice which makes reflective and integrative learning 
practices and processes visible—to students, to faculty and staff, and to external 
audiences. Moreover, the ePortfolio is not limited to a single course or learning 
experience, and when done well, spans the entire student learning experience. 
Thus, students can see not only their growth over time, but the ways seemingly 
disparate learning experiences connect into a cohesive whole. ePortfolio tech- 
nology allows students to involve peers, faculty, staff, and external audiences in 
understanding and enriching their learning, something a traditional assignment 
or activity typically does not. 


Thus, ePortfolio is not a “plug and play” technology. Building academic skills 
and developing self-understandings and dispositional attributes do not hap- 
pen by simply making the technology available to students, faculty, and staff. 
Professional development is essential for helping faculty and staff implement 
reflective learning opportunities that take advantage of some of ePortfolio’s key 
features. 


ePortfolio, therefore, is a set of reflective practices that, when done well, makes 
authentic learning and personal development visible, comprehensible, and 
meaningful, induces students to draw connections between various learning 
and personal development experiences inside and outside of class on and off the 
campus, fosters integrative learning, and deepens dispositional attributes. 


The Importance of ePortfolio “Done Well” 


To discover and advance best ePortfolio practice with an emphasis on reflection 
and assessment was a goal of the FIPSE-funded Connect to Learning 
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project (C2L) led by the Making Connections National Resource Center at La- 
Guardia Community College (CUNY). C2L formed a community of practice 
of ePortfolio practitioners from 24 cross-sector institutions. Its goals were to 
support and strengthen ePortfolio initiatives at participating institutions, de- 
velop a framework for effective ePortfolio practice, and examine the impact of 
ePortfolio practice at multiple levels of campus life. C2L leaders worked with 
participating campus teams to gather evidence about the efficacy of effective 
ePortfolio practice, using a common survey instrument, the C2L Core Survey 
(http://c2l.menrc.org/evidence/evidence-2/) which included questions used 
with permission from the National Survey of Student Engagement (NSSE). 
While all teams focused on student learning and success, each institution also 
developed indicators appropriate to their campus and students. Of particular 
interest was documenting the relationships between the student ePortfolio ex- 
perience, learning, and other outcomes such as persistence, along with faculty, 
staff, and institutional leaders’ perceived value of ePortfolio in their own work 
(Eynon & Gambino, 2017). 


The C2L project and its findings summarized by Eynon, Gambino, and Torok 
(2014) and Eynon and Gambino (2017) concluded that ePortfolio practice 
done well helps foster student success, as measured by pass rates, GPA, and 
persistence. At LaGuardia Community College (CUNY), for example, the 

one semester persistence rate for students in ePortfolio courses averaged 9-11 
percentage points higher than peers in other courses. 


In addition, ePortfolio students more frequently engaged in deep learning 
behaviors (Nelson Laird, Shoup, Kuh, & Schwartz, 2008), such as synthesiz- 
ing and organizing ideas, thinking critically, and applying theoretical concepts 
to unfamiliar situations. Finally, C2L results suggested that ePortfolio practice 
helps students build not only academic skills but also the affective under- 
standings of self and the dispositional attributes needed for success in today’s 
workforce. 


Features of High-Impact ePortfolio Practice 


Why is ePortfolio so well-suited for making these dispositional attributes vis- 
ible? As mentioned earlier, ongoing reflection is essential and will be explored 
in detail below. But there are other key features of ePortfolio practice that, 
when leveraged effectively, with careful attention to structure and process, sup- 
port these types of learning. 


Ownership. While schools provide the technology platform as well as struc- 
tured templates to guide students in developing their ePortfolio, the student 
owns his/her ePortfolio. But, ownership goes beyond what the terms of any 
software license state. Student ownership is about having a space, a virtual 
“studio,” to experiment with practice and process and having the ability to 
customize that space; to leverage multimedia capabilities - color, images, video 
- in a way that represents who they are at that current moment. This type of 
ownership can help today’s students understand that they are active agents in 
their learning and capable of constructing knowledge that can be shared with 
others. Having a “space of their own” to reflect on their learning can encourage 
students to identify and articulate those “beneath the surface” dispositions such 


C2L results suggested that ePort- 
folio practice helps students build 
not only academic skills but also 
the affective understandings of 
self and the dispositional attri- 
butes needed for success in today’s 
workforce. 
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Making Learning Visible. Through collecting and reflecting on learning 
artifacts and experiences, ePortfolio practice prompts students to make their 
learning more visible, to themselves and others. Often, the only audience for 
student work is a faculty member. Students turn something in, it is reviewed 
and graded by the instructor, and then returned to the student where it is most 
likely looked at for a grade and feedback and filed away. ePortfolio provides the 
structured opportunity for students to share their work more broadly. They are 
able to look back at previous work in their ePortfolio to see their own learning 
over time. 


ePortfolios can be shared with peers, advisors, other faculty, family members, 
potential employers, and others, making a student’s learning visible in new 
ways. In this sense, involving external audiences in the process induces students 
to think differently about what they know and can do. Because an ePortfolio is 
typically replete with artifacts of authentic learning, these artifacts serve as evi- 
dence to assess a range of learning outcomes including dispositional attributes. 


Longitudinal Capacity. Developing over time and across boundaries - ePort- 
folio provides scaffolded opportunities for learning and reflection, enabling and 
deepening the development of such dispositional attributes as intrapersonal and 
interpersonal competencies and neurocognitive skills. Because ePortfolio, when 
done well, is longitudinal in nature, the reflective component of the process 
helps students make connections among their different learning experiences— 
in a given academic term as well as the entire student learning experience in 
and out of the classroom. 


Identity Development. Portfolio emphasizes development of the “whole” 
person by prompting students to connect and make meaning from diverse 
learning experiences which helps students develop more purposeful identi- 

ties as learners. Structured reflection provides an opportunity to synthesize 

and integrate lived experiences with academic experiences, and for students to 
consider who they are and who they are becoming as these essential intraper- 
sonal and interpersonal competencies develop. ePortfolio processes put students 
in situations where they can draw on and deepen dispositional attributes, such 
as academic self-efficacy, a growth mindset, conscientiousness, and utility and 
intrinsic goals, all of which are important to identity development and integra- 
tive learning. 


While these features - ownership, longitudinal capacity, and visibility - are 
important to the ePortfolio process; reflection is at the heart of a high-impact 


ePortfolio practice. 


Reflective ePortfolio Practice 


Reflection is critical to helping students connect and make meaning from 
diverse learning experiences—in courses, in other high-impact activities, and in 
educationally purposeful experiences on and off campus. By making reflection 
a habit of mind and heart, students develop the ability to routinely integrate 
various learning experiences into a larger framework of personal development 
and purposeful self-authorship. According to Carol Rodgers (2002), “The 
function of reflection is to make meaning, to formulate relationships and 


ePortfolios can be shared with 
peers, advisors, other faculty, fam- 
ily members, potential employers, 
and others, making a student's 
learning visible in new ways. 
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what it means to be human. It is what enables us to make sense of and attribute 
value to the events of our lives” (p. 848). 


Reflection provides the opportunity to pause - to step back in a way - and in- 
tentionally consider and make-meaning from one or more learning experiences. 
It can help students articulate their learning, not just of disciplinary knowledge 


but of the dispositional attributes they need to practice and develop to be suc- 
cessful. 


What does meaningful reflection look like? How can faculty and staff use 
reflection effectively to help students articulate their learning? What types of 
prompts and practices elicit the competencies and behaviors employers are 


seeking? 


Rodgers identified four principles for meaningful reflection (2002): reflection 
as connection, reflection as systematic and disciplined, reflection as social peda- 
gogy, and reflection as an attitude towards change (p. 845). These categories (as 
depicted in Figure 7) are not distinct. One reflective activity may by systematic 
and disciplined and provide opportunities for connection. Another may use 
social pedagogy and reflection in community to help students develop a dispo- 
sition toward change as they make connections between different experiences. 


In the sections below, we briefly describe each reflection category and share an 
example of what this looks like in practice. While a growing number of institu- 
tions engage students in high-impact ePortfolio practice, (including Yale, Ari- 
zona State University, Elon, Binghamton, and LaGuardia Community College) 
we use examples from Guttman Community College (CUNY) to illustrate the 
value of reflective practice. At Guttman, all students create a reflective learning 
ePortfolio in their required Bridge program. This ePortfolio is then developed 
across their entire learning experience, providing multiple opportunities for 
reflection in a range of activities and High-Impact Practices both inside and 
outside the classroom. Students engage regularly in self-assessment via their 
reflective practice and also submit their learning ePortfolios for assessment at 
three milestones: the end of the Guttman’s Summer Bridge Program (bench- 
mark ePortfolio), the end of their First-Year Experience (milestone ePortfolio), 
and at the end of their program of study (capstone ePortfolio). 
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Reflection as Reflection 


connection and Personal ir ‘s af 
Change * Goal Settir 
8" * Ma 8 


Reflection in Reflection as 
Community Systematic 


Figure 7: Dewey's Criteria for Reflection. 


Reflection as connection is practiced in Arts in New York City, a required 
First-Year Experience course at Guttman. As their signature assignment, 
students create an art piece that describes some aspect of their relationship 

to New York City. The prompt for this activity encourages them to, “Think 
about the role of the arts in shaping your identities (gender, racial, class, ethnic, 
religious), your childhood, and your view of your community.” As part of their 
ePortfolio, students complete a project proposal, showcase their piece, and then 
reflect on the process. As part of that final reflection, students are prompted to 
engage in self-inquiry: 


Think about what you hoped to create and communicate. Describe 
the process you undertook to create this project. Were you able to 
achieve your goals? In what ways did you apply concepts you learned 
in class to this project? What does this piece say about you and your 
relationship to New York City? What did you learn about yourself as 
you developed this piece of art? 


In addition to connecting both course-based content knowledge and the 
experiences they had in the community, students are asked to articulate their 
“beneath the surface learning” in terms of conscientiousness, academic self- 
efficacy, a growth mindset, and a positive future self. Their reflections then 
become a powerful articulation of their learning, as evidenced by this student’s 
response: 


As an African American woman, I felt that my culture was always be- 
ing whitewashed, meaning that serious aspects of African Americans 
triumphs were being ignored or under credited. When I would see 
photographs in the textbooks they always had photos of white men 
and women, which ultimately left me wondering about my African- 
American history and our struggle which was going unheard. Jamel 
Shabazz mainly focused on African Americans in urban areas of New 
York, you see the pain and happiness of the 80’s and how people 
dressed and lived which I think is the most important part of photog- 
raphy. 
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I think one of the most important aspects of photography is the 
cultural impact it can have on people by making us aware of what 
people went through back then. I think my Arts in New York City 
class made [me] value my culture and history way more, which I 
thought was impossible since I really liked educating myself on the 
tribulations that African American women and men faced and how 
long we came. If it was not for my Arts in New York City class, I 
would never know artists like Kehinde Wiley, Awol Erizku, and Diane 
Arbus and their contribution to society and changing the way I viewed 
conventional art. 


At Guttman this reflective practice provides an opportunity for first-year 
students to begin to practice these dispositions that they will continue to hone 
across their future learning experiences. 


Reflection as Social Pedagogy: While reflection is often thought of as a soli- 
tary activity, there is value in reflecting with others. Dewey (1916) suggests that 
meaningful learning and reflection often happens in community, in conversa- 
tion, and in interaction with others. Reflecting in community - sharing and 
discussing their learning with others - adds depth and power to integrative 
learning and the cultivation of dispositions and neurocognitive skills. ePortfolio 
provides an opportunity for what Bass and Elmendorf (n.d.) call social peda- 
gogy—the co-construction of knowledge for authentic audiences. Students can 
share and receive feedback from their peers via ePortfolio and can work with 
others to co-create ePortfolios for specific projects or activities. These activities 
both encourage them to develop and share information with others as well as 
strengthen individual academic self-efficacy, growth mindsets, and a sense of 
belonging—foundational to the dispositional learning they need. 


Guttman students engage in social pedagogy during the Bridge Program, 
which requires them to create a personal learning ePortfolio and co-construct a 
group ePortfolio as part of a research project. The topics for the projects vary 
but typically involve researching a New York City neighborhood, which is then 
connected to the Bridge Program’s common reading, such as The Diary of a 
Part-Time Indian. Working in teams, students focused on identifying indicators 
of poverty and privilege, comparing and contrasting their assigned neighbor- 
hood to the setting of Diary. 


This excerpt of an ePortfolio page from a group assigned to University Heights, 
a neighborhood in upper Manhattan, illustrates how students “constructed” 
knowledge in their ePortfolio: 


Indicators of Poverty: In University Heights we looked for 4 indica- 
tors of poverty. They were graffiti, homeless people, litter and food 
trucks. We saw 6 walls and poles filled with graffiti on them. For 

the homeless people, we didn’t see any, on account of the rain, but we 
did find their belongings in shopping carts. Also, we saw a lot of over 
flowing litter around in the streets... 

Indicators of Privilege: As we were walking through the neighborhood 
we saw a lot of different signs of privilege... There were many clinics 


Reflecting in community - sharing 
and discussing their learning with 
others - adds depth and power 

to integrative learning and the 
cultivation of dispositions and 
neurocognitive skills. 
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around the neighborhood, also 8-9 pharmacies...Another positive 


thing about University Heights is that there were lots of transportation 


options....People around this area seem to feel safe and happy living 
hete,,: 

NYC neighborhood to Reardan, WA: University Heights and Rear- 
dan, WA are both different neighborhoods. Reardan is a very privi- 
leged neighborhood with one of the best schools. Most of the people 
there are wealthy and have not experienced poverty. University 
Heights showed both poverty and privilege. 


After completing their ePortfolio, each group presents their work to their 
faculty, advisor, peers, and occasionally other members of the Guttman com- 
munity. Students then individually reflect on their Bridge experience in their 
personal ePortfolio. 


Conducting group research, creating an ePortfolio, and sharing that learning 
with the community fosters and deepens dispositional learning, including the 
development of conscientiousness, academic self-efficacy, growth mindset, and 
a sense of belonging. The concepts of belonging and academic self-efficacy are 
critically important to all students and especially to first generation, minority, 
and those academically under-prepared. Guttman students begin, early on, to 
see that they have something to contribute as a member of the Guttman com- 
munity. 


Reflection as Systematic and Disciplined: Some consider reflection to be 
vague, unstructured musing. But Rodgers (2002) argues that reflection can be 
a systematic, rigorous, disciplined way of thinking, with its roots in scientific 
inquiry. She lays out Dewey’s structure for an ideal reflective process, moving 
from experience to observation, then analysis and finally to implications and, 
possibly, the development of new, experimental actions. In simpler terms, we 
can think of this as a process of answering three questions: What? So what? 
Now what? This systematic and disciplined reflection process is common in 
disciplinary subjects such as science, allied health, and business. But it can also 
be an important reflective practice in high-impact practices that take place 
outside the classroom. 


Global Guttman is a study abroad program that integrates ePortfolio practice 
throughout the program. Global Guttman experiences are linked to academic 
courses in student’s program of study usually in the second year; students 
complete pre-, during, and post-trip reflections, connecting their lived experi- 
ence to their coursework and considering their emerging global identity and 
citizenry. While on their trip, students complete daily journal entries, where 


Conducting group research, creat- 
ing an ePortfolio, and sharing 
that learning with the community 
fosters and deepens dispositional 
learning, including the develop- 
ment of conscientiousness, aca- 
demic self-efficacy, growth mind- 


set, and a sense of belonging. 


they reflect in a systematic, disciplined way. Students are asked to consider their 
sense of belonging in terms of a larger community. They are also encouraged to 
see a more positive future self and consider their intrinsic, utility, and pro-social 
goals as demonstrated by this student’s reflection. Below she reflects in a daily 
journal entry on her experience in Belize, the personal difficulties she faced 


(What?), how she moved past them (So What?), and what she learned from 
them (Now What?) 
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What? Since it’s rainy season in Belize, it rains every single day and 
because of this, there are many bugs. I disliked his farm because of the 
bugs. 

So What? | learned from this that in some scenarios, there aren't any 
solutions, but I have to learn to deal with it, especially with the oppor- 
tunity. The whole experience in Belize overpasses that scenario with 
the bugs. 

Now What? Now that I traveled to Belize, I want to major in Anthro- 
pology...I want to be able to travel the world and feel like I made a 
difference in the world. 


The opportunity to reflect helped this student articulate her emerging sense of 
belonging and place in the global community, her sense of a positive future self, 
and a growth mindset, all key capacities of dispositional learning. 


Reflection as an Attitude toward Change: “Reflection” involves “attitudes 
that value the personal and intellectual growth of oneself and others” (Rodgers, 
2002, p. 845). Thus, reflection induces neurocognitive activity as well as engag- 
es the affective domain, thereby shaping such dispositions as openness, curios- 
ity, and a readiness to reconsider long-held ideas about oneself and the world. 
Hodge et al, (2009) refers to this as self-authorship, where students establish 
goals, make and pursue plans, and build their identity. Reflective ePortfolio 
practice can support these goals, helping each student develop his or her inner 
voice and the intrinsic and utility goals needed to function as an empowered 


individual. 


Learning about Being a Success Student (LaBSS) is a first-year academic sup- 
port space where first-year students meet weekly as a class with their advisor. 
The advising curriculum focuses on educational planning and goal setting for 
students, helping them develop their professional identities. ePortfolio practice 
is integrated across the curriculum, beginning in Bridge, where students com- 
plete a personal SWOT (Strengths, Weaknesses, Opportunities, and Threats) 
analysis. Students, over the course of the academic year, engage in research into 
the Guttman programs of study, before declaring their major. Lastly, students 
complete a PROFolio, a page in their ePortfolio which is their first “public” 
declaration of their professional identity. The PROFolio includes a professional 
headshot, a short video introduction, a resume, and several personal state- 
ments. These statements, along with the other components of the PROFolio, 
provide students the opportunity to integrate their learning from the previous 
experiences in and out of the classroom and articulate their future plans and 


the steps they will take to achieve them. Here is an excerpt from one student's 
PROFolio reflection: 


Iam a first-year student at Guttman College and I am currently 
majoring in Urban Studies, but I plan on studying environmental 
sciences in the future. During my first year in Guttman I took a city 
seminar class, history class, sexuality/gender class, and arts in NYC 
class. My arts in the city class helped me realize that I have an interest 
in photography and learning about NYC. I am currently working on 
developing my analytical skills further. ... In the future I would want 
to be a conservationist/environmentalist. I always had an interest in 


“Reflection” involves “attitudes 
that value the personal and intel- 
lectual growth of oneself and 
others.” Thus, reflection induces 
neurocognitive activity as well 

as engages the affective domain, 
thereby shaping such disposi- 
tions as openness, curiosity, and a 
readiness to reconsider long-held 
ideas about oneself and the world. 
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I always had an interest in animals and protecting the environment is 
very important to me. 


ePortfolio helps students find 


Through this experience and iterative, reflective ePortfolio practice, students 


further develop conscientiousness, academic self-efficacy, and goal setting. their place in a larger academic 
ePortfolio helps students find their place in a larger academic community and community and in the world, and 
in the world, and induces them to concretize this vision of their positive future induces them to concretize this 
self and to share it with others. vision of their positive future self 


. and to share it with others. 
These examples demonstrate ways that reflective practice, scaffolded across the 


breadth of one’s collegiate learning experiences, can be a powerful opportunity 
for a student to further develop intrapersonal and interpersonal competen- 
cies and other dispositional attributes. Students are able to look back on prior 
reflections to see their growth and development. Not only does ePortfolio 
practice make this learning visible to students, but it allows others to view it 
as well. ePortfolio, when connected to course, programmatic, or institutional 
assessment, can be a way for faculty and staff to provide students the opportu- 
nities needed to develop these essential skills. 


ePortfolio as a Meta-High-Impact Practice 


Like any other High-Impact Practice, ePortfolio must be “done well” to foster 
deep, meaningful learning and bring it to the surface to guide outcome assess- 
ment efforts. As the examples above illustrate, ePortfolio practice, when done 
well, incorporates many of the High-Impact Practice features identified by 
Kuh, O’ Donnell and Reed (2013), such as reflection, peer and faculty feed- 
back, a substantial investment of time and effort over an extended period of 
time, and public demonstration of competence. It should not be surprising that 
ePortfolio, therefore, is well-positioned to work in concert with other High- 
Impact Practices, such as first-year seminars, capstone courses, study abroad, 
and undergraduate research. 


In addition to these features, ePortfolio’s longitudinal quality that spans the 
entire student learning experience is very important. “This longitudinal quality 
of effective ePortfolio practice can facilitate the integration of multiple HIPs 
across a student’s academic trajectory” (Eynon & Gambino, 2017, p. 202), 
serving as a “meta” High-Impact Practice. This longitudinal feature allows 
many opportunities for students to reflect on and integrate learning from these 
HIPs, to make connections among what are often disparate experiences to form 
a cohesive whole, and serve as a signature student learning experience. 


When ePortfolio serves this “meta” purpose, students are able to both practice 
and integrate dispositional attributes, and develop a process for continuing to 
develop them as they move beyond our institutions, positioning them for suc- 
cess in today’s and tomorrow’s workplace. 
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Final Words 


The growing concerns about the quality of higher education is a clarion call To close achievement gaps and 
to collective action. Fortunately, recent research about effective educational prepare students to meet the 
practice offers guidance about how student learning can be improved inside challenges of the 21st century 


and outside the classroom. 


workplace, ensuring that ALL 


Some students begin college with a relatively well-developed set of dispositional students participate in multiple 


attributes, but many do not. To close achievement gaps and prepare students to well-designed High-Impact Prac- 
meet the challenges of the 21st century workplace, ensuring that ALL students tices early and later during their 
participate in multiple well-designed High-Impact Practices early and later dur- undergraduate studies in order to 
ing their undergraduate studies in order to help foster further development of help foster further development of 


dispositional attributes must be priorities. dispositional attributes must be 


Included in the constellation of dispositional attributes featured in this paper PEE 
are neurocognitive skills that represent the malleable learning and development 

that integrates crystallized intelligence (easily identifiable learning) and fluid in- 

telligence (less easily identified learning and development). At the core of fluid 

intelligence, are behaviors that can be intentionally cultivated, such as reflec- 

tion, resilience, deliberate problem solving, emotion regulation, and conscien- 

tiousness. These behaviors are foundational to develop crystallized intelligence. 


Well-designed ePortfolios are a proven approach for engaging students in effec- 
tive educational practices and deepening their learning. As demonstrated ear- 
lier, the ePortfolio process can help students cultivate dispositional attributes in 
the form of intrapersonal and interpersonal competencies and neurocognitive 
skills. In addition, ePortfolio is especially useful for documenting the extent to 
which students are learning and growing in desired ways. 


Key to ePortfolio’s effectiveness is the process of combining first-person 
structured reflections with direct evidence in the form of artifacts representing 
authentic learning from a range of student experiences such as HIPs and other 
educationally purposeful activities, both in and out of the classroom. The pro- 
cess allows students to craft an evolving narrative of who they are and who they 
are becoming that can then be used for self-assessment as well as institutional 
assessment. To complement the ePortfolio data collection, institutions can also 
use pre- and post- measures of student learning and development such as those 
in Appendix A to assess the extent to which participating in HIPs contribute to 
the development of dispositional attributes. As a result, learning and develop- 
ment that was not so easily visible before can become more readily identifiable 
as shown in Figure 8. 


Research on the effectiveness of HIPs, attention to and assessment of dispo- 
sitional attributes, and the usefulness of an ePortfolio as an assessment tool 
emerged independently. However, they are primed for a convergence. And as 
they converge, college and university faculty and staff will obtain learning- 
rich evidence of the worth of postsecondary education to individuals and the 
public, and actionable data to guide continuous improvement. In addition, we 
expect the convergence and adaptation of these concepts will further higher 
education's long transition from instruction-centered to learning-centered de- 
livery that Barr and Tagg (1995) called for more than two decades ago. 
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ePortfolio 


High-Impact Practice 


Figure 8: Assuring Dispositional Learning. 


Maximizing the impact of HIPs participation on dispositional attributes using 
ePortfolio will require coordinated action across the institution. Toward that 
end, we present some questions for institutional leaders, faculty, and staff to 
consider: 


BOR 


. What kinds of HIPs does your institution offer? 
. Which students currently participate in one or more HIPs? 
. What can be done to reduce existing inequities in HIPs par- 


ticipation? 


. To what extent do the activities labeled a HIP embody the 


engaging features characteristic of high quality HIPs and how 
do you know? 


. How might reflective assignments and ePortfolio design be 


modified to foster the acquisition of and obtain direct evi- 
dence of dispositional attributes such as fluid and crystalized 
intelligence? 


. What must be done for your institution to leverage the rich 


data that ePortfolios generate to: 
(a) demonstrate the value of a degree, 
(b) close achievement gaps, and 
(c) document the extent to which graduates have acquired 
dispositional attributes? 


The field is in a nascent stage in discovering the most viable approaches to 
helping students cultivate what are essential dispositional attributes in the form 
of intrapersonal and interpersonal competencies and neurocognitive skills. We 
are optimistic that the combination of HIPs and ePortfolio will advance this 
important work and invite you and your colleagues to join us in this endeavor. 


The field is in a nascent stage 

in discovering the most viable 
approaches to helping students 
cultivate what are essential dispo- 
sitional attributes in the form of 
intrapersonal and interpersonal 
competencies and neurocognitive 
skills. We are optimistic that the 
combination of HIPs and ePort- 
folio will advance this important 
work and invite you and your col- 
leagues to join us in this endeavor. 
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Appendix A: Selective Pre- and Post-Measures of Dispositional Learning 


Dispositional Learning 


Outcome 
Academic Self-Efficacy 


Attention and Emotion 
Regulation 


Compassion/Pro-Social 
Behavior 


Conscientiousness 


Engagement 


Grit 


Growth Mindset 


Purpose 


Data Collection Instrument ae 
Academic Self-Efficacy Scale | Measures confidence in 
(Chemers, Hu, & Garcia, 2001) | abilities. 


Five Facet Mindfulness 
Questionnaire (FFMQ) (Baer et 
al, 2008) 


Multidimensional Compassion 
Scale (MCS) (Jazaieri et at., 
2014) 


Chernyshenko 
Conscientiousness Scales 
(CCS) (Green et al, 2015) 


National Survey of Student 
Engagement (NSSE) 


Grit Scale (Duckworth & 
Quinn, 2009) 


Measures five facets of 
mindfulness: observing, 
describing, acting with 
awareness, non-judging of 
inner experience, and non- 
reactivity to inner 
experience. 

Measures four components 
(awareness of suffering 
(cognitive component); 
sympathetic concern 
(empathy) triggered by 
suffering (affective 
component); desire to 
relieve suffering 
(intentional component); 
and readiness to help 
relieve suffering (action 
component). 

Measures industriousness, 
order, self-control, 
traditionalism, virtue, and 
responsibility. 

Measures engagement of 
higher-order learning, 
reflective and integrative 
learning, learning 
strategies, quantitative 
reasoning, collaborative 
learning, discussions with 
diverse others, student- 
faculty interactions, 
effective teaching 
practices, quality of 
interactions, and 
supportive environment. 
Measures perseverance in 
achieving goals and 
consistency of interests 
over time. 


Growth Mindset Intelligence Measures self-perceptions 
Scale (Dweck, 1999) of abilities. 
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Mental Well-Being 


Personal and Social 
Responsibility 


Psychological Well-Being 


Resilience 


Self-Control 


Self-Regulation 


Sense of Belonging 


Warwick-Edinburgh Mental 
Well-being Scale (WEMWBS) 


(2006). 


Personal and Social 
Responsibility Inventory 
(Reason, 2013) 


Psychological Well-Being 


(Ryff, C.D. & Keyes, C.L.M., 


1995) 


Brief Resilience Scale (Smith et 
al, 2008) 

Self-Control Scale (Tsukayama, 
Duckworth & Kim, 2013) 


Self-Regulation Scale 
(Schwarzer, Diehl, & 
Schmitz, 1999) 

Sense of Belonging Scale 
(Hoffman et al., 2002) 


Measures overall mental 
well-being and the effects 
of participation in 
programs and projects on 
mental well-being. 


Measures five dimensions: 


striving for excellence; 
cultivating academic 
integrity; contributing to 
larger community; taking 
seriously the perspectives 
of others; and ethical and 
moral reasoning. 
Measures autonomy, 
environmental mastery, 
personal growth, positive 
relations with others, 
purpose in life, and self- 
acceptance 


Measures ability to 
“bounce-back” following 
an adverse experience. 
Measures ability to 
regulate interpersonal and 
social impulsivity. 
Measures attentional 
control in goal pursuit. 


Measures perceived peer 
support, faculty 
support/comfort, 
classroom comfort, 
isolation, and empathetic 
faculty understanding. 
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